Semantically Meaningful Class Prototype Learning for One-Shot Image Segmentation
نویسندگان
چکیده
One-shot semantic image segmentation aims to segment the object regions for novel class with only one annotated image. Recent works adopt episodic training strategy mimic expected situation at testing time. However, these existing approaches simulate test conditions too strictly during process, and thus cannot make full use of given label information. Besides, mainly focus on foreground-background target setting. They utilize binary mask labels training. In this paper, we propose leverage multi-class information It will encourage network generate more semantically meaningful features each category. After integrating cues into query features, then a pyramid feature fusion module mine fused final classifier. Furthermore, take advantage support image-mask pair, self-prototype guidance branch segmentation. can constrain generating compact robust prototype class. For inference, Specifically, prediction extract pseudo-prototype combine it initial prototype. Then guide Extensive experiments demonstrate superiority our proposed approach. The source codes models have been made available https://github.com/NUST-Machine-Intelligence-Laboratory/SMCP .
منابع مشابه
One-Shot Learning for Semantic Segmentation
Low-shot learning methods for image classification support learning from sparse data. We extend these techniques to support dense semantic image segmentation. Specifically, we train a network that, given a small set of annotated images, produces parameters for a Fully Convolutional Network (FCN). We use this FCN to perform dense pixel-level prediction on a test image for the new semantic class....
متن کاملZero-Shot Learning on Semantic Class Prototype Graph.
Zero-Shot Learning (ZSL) for visual recognition is typically achieved by exploiting a semantic embedding space. In such a space, both seen and unseen class labels as well as image features can be embedded so that the similarity among them can be measured directly. In this work, we consider that the key to effective ZSL is to compute an optimal distance metric in the semantic embedding space. Ex...
متن کاملOne-Shot Segmentation in Clutter
We tackle the problem of one-shot segmentation: finding and segmenting a previously unseen object in a cluttered scene based on a single instruction example. We propose a baseline architecture combining a Siamese embedding for detection with a U-net for segmentation and evaluate it on a novel dataset, which we call cluttered Omniglot. Using oracle models with access to various amounts of ground...
متن کاملHyperspectral Image Segmentation with Discriminative Class Learning
This paper presents a Bayesian approach to hyperspectral image segmentation that boosts the performance of the discriminative classifiers. This is achieved by combining class densities based on discriminative classifiers with a Multi-Level Logistic Markov-Gibs prior. This density favors neighboring labels of the same class. The adopted discriminative classifier is the Fast Sparse Multinomial Re...
متن کاملOne-Shot Imitation Learning
Imitation learning has been commonly applied to solve different tasks in isolation. This usually requires either careful feature engineering, or a significant number of samples. This is far from what we desire: ideally, robots should be able to learn from very few demonstrations of any given task, and instantly generalize to new situations of the same task, without requiring task-specific engin...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Multimedia
سال: 2022
ISSN: ['1520-9210', '1941-0077']
DOI: https://doi.org/10.1109/tmm.2021.3061816